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1.  INTRODUCTION 


This  workshop  on  "Automatic  Pattern  Recognition"  represents  the  second  of 
a  series  of  intensive  academic/  government  interactions  in  the  field  of 
advanced  electro-optics,  as  part  of  the  Army  sponsored  University  Research 
Initiative.  By  documenting  the  associated  technology  status  and  dialogue  it  is 
hoped  that  this  baseline  will  serve  all  interested  parties  towards  providing  a 
solution  to  high  priority  Army  requirements.  Responsible  for  program  and 
program  execution  are  Dr.  Nicholas  George.  University  of  Rochester  (ARO- 
URI)  and  Dr.  Rudy  Buser,  NVEOC. 


2.  SUMMARY  -  INCLUDING  FOLLOW-UP 


University  of  Rochester:  The  workshop  group  consisted  of  Professor  Nicholas 
George,  Dr.  Thomas  Stone,  Dr.  Robert  Rolleston  (graduated  this  year  -  1988) 
and  Dennis  Venable,  planning  to  graduate  in  1989. 

The  main  points  of  briefings  by  George,  Rolleston,  and  Venable  are  as 
follows: 

a.  In  pattern  recognition  that  is  pixal  intensive,  there  is  considerable 
merit  in  optical  preprocessing  or  a  parallel  channel  of  processing 
that  works  at  high  rate  coupling  in  auxiliary  data  to  a  more 
conventional  all-dfigital  system.  Examples  are  optical  transforms  in 
white  light  (cosine,  sine.  Hartley,  or  Fourier),  direct  correlation 
schemes  as  by  Morris  at  UR,  and  the  neural  network  models  that 
provide  high-speed,  parallel  computation  and  are  being  studied  at 
numerous  laboratories. 

b.  Various  light  valve  schemes  are  getting  better  and  better;  and  as 
they  do  it  is  worthwhile  considering  coherent  diffraction  pattern 
sampling.  Some  recent  classifications  or  ^w’tings  were  described. 

c.  Image  retrieval  was  described  including  recent  work  of  Rolleston 
on  Fresnel-zone  retrieval. 

Imaging  of  the  type  simulating  current  Army  objectives  in  pattern 
recognition  were  shown  by  the  Army  scientists.  There  were  discussions  about 
UR  being  able  to  access  these  images  for  test  purposes,  and  we  should  follow¬ 
up  on  this. 
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Diffraction  Pattern  Sampling 


George,  Nicholas,  Automatic  Pattern  Recognition,  The  Institute  of  Optics  Summer  School  Notes,  1984 


Hybrid-Optic 

Diffraction  Pattern  Sampling  System 
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Monitor  MC5500  Package 
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Analysis  of  Aerial  Photography  * 


Film  Grain  Spectra  using 
Coherent  Optical  Methods 


Image  Quality 


Sensitivty  range  for  Image  Quality  Measurement 


^  Single  image  -  Many  image  classes 


Pooled  Wedge  DifTerence  Sum  Algorithm 


The  pooled  wedge  diffeience  sum  algorithm  is  demonstrated  above.  The  PWDS  is 
calculated  for  a  sample  against  the  pooled  (average)  vectors  for  classes  1  and  2.  Low 
feature  values  correspond  to  a  high  degree  of  similarity.  In  the  above  example,  the 
sample  most  nearly  marches  class  1  as  PWDS  value  of  66  is  significantly  less  than  210. 


Example  of  the  Spike  Width  (SpW)  feature  algorithm. 
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Shen-ge  Wang,  Optical  Transforms  in  White  Light,  Ph.D.  Thesis, 
University  of  Rochester,  1986. 
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Image  Recovery 


Given  only  partial  information  about 
an  image  and  the  transform.  Is  it 
possible  to  recover  (or  reconstruct)  the 
unknown  image? 


Computer  Aided  Tomography: 


Given  the  Fourier  spectrum  only  in  a  wedge  shaped 
region,  it  is  possible  to  fill  in  the  missing  portion  of 
the  spectrum  and  thus  recover  the  unknown  image. 


History 


1892  A.  A.  Michelson  and  Lord  Raliegh 

•  visibility  fringes 

1965  Walther;  Wolf 

•  analytic  properties  of  functions 

1974  Napier  and  Bates 

•  2-D  Polynomials 


1971  Gerchberg  and  Saxton 

•  iterate  between  two  planes 


1982  Youla  and  Webb 
•  convex  projections 


Fourier  Transform 

G(fx.fy)s//g(x.y)exp{-i2n(xfx  +  yfy)}dxdy 
g(x,  y)  =/ /G(fx,  fy)exp{  +  I2n(xfx  +  yfy)}  dfx  dfy 

Polar  Form 

Magnitude:  lG(fx,  fy)l  ®  [G(fx.fy)G*(fx,fy)lT 


Phase: 


cosICD(fx,  fy)l  = 
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Gerchberg-Saxton  Algorithm 
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Magnitude  Retreival 

(Oppenheim,  Urn,  Hayes,  1981) 
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d  ^  F  :  Fresnel  Zone  Transform 


FRESNEL-ZONE  TRANSFORM  PAIR 

G(fx.  fy)  =  ff 3(x,  y)  K(x,y;  fx.fy)  dx  dy 
g(x,  y)  -  ff  S(fx,  fy)  K*(x,y:  fx.fy)  dfxdfy 

Transform  Kernel 

K(x,y;fx,fy)  =  exp{-inai  (x2  +  y2)  -i2n(fxX  fyy)} 
Offset  parameter 

ai»  (1  -  di/F)/(AF) 

Number  of  Fresnel  Zones 


Zf  =  [  ai  (Xmax)2 1  /  2 


Image  Retrieval 

(Rolleston  and  George,  1986) 
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MAGNITUDE-ONLY  RECONSTRUCTION 


Given  Magnitude  of  Fresnel-zone  Transform 
IG(fx.fy)l 

and  constraints  on  g(x,y) 

g(x,y)  is  real 

g(x,y)  is  non>negative 

g(x,y)  has  a  known  size 


Find:  exp{i(t)(fx,fy)}  and  g(x,y) 


U( _ new  guess: 


Iterative  Technique  of  Image 
Reconstruction  from  Magnitude  Information 


Original  Image 

256  X  256  Pixels 
256  Gray  Levels 


Given  Magnitude  Data 


PHASE-ONLY  RECONSTRUCTION 


Given  Phase  of  Fresnel-zone  Transform 

exp{  i0(fx,  fy)} 

and  constraints  on  g(x,y} 

g(x«y)  is  real 

g(x,y)  is  non-negative 

g(x,y)  has  a  known  size 


Find:  IG(fx,fy)l  and  g(x,y) 


current  guess:  Qp 


Initial  random  guess:  go 
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- new  guess:  gp^i 


Iterative  Technique  of  Image 
Reconstruction  from  Phase  Information 


Conclusions: 


•  Image  recovery  from  partial  Fresnel-zone 
information  has  been  demonstrated. 

•  Phase-only  reconstructions  have  a  slight 
degradation  when  moving  out  of  the  Fourier 
plane  and  into  the  Fresnel  region. 

•  Magnitude-only  reconstructions  are  greatly 
improved  when  moving  out  of  the  Fourier  plane 
and  into  the  Fresnel  region. 


Problem:  Imaging  Through  Turbulence 


Degradation  Model  (short  exposure) 


P(fxi  fy)  —  B(fx,  f 


Image  Recovery:  Current  Research 

Beam  Splitter 
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CECOM  Tests 

Automatic  Target  Recognizer 


The  Army  reports  a  significant  ad\'ance  in  its  de\'elopment 
of  a  ne\i’  generation  of  night  vision  equipment  with  the 
completion  of  tests  on  an  automatic  target  recognizer. 

Test  director  John  Farr  of  the  Army  Communications-Elec- 
tronics  Command  ( CECOM )  Center  for  Night  \ision  and 
Electro-Optics.  Fort  Belvoir.  VA,  said  the  successful  tests  pro¬ 
duced  14  sets  of  videotapes  of  collected  imagery-.  "The  data 
will  be  used  in  the  development  of  night  vision  equipment 
designed  to  reduce  the  pilot's  workload  and  the  time  it  takes 
to  find  a  target. "  f^rr  said. 

Tests  were  conducted  with  a  sensor  package  mounted  on 
the  nose  of  a  helicopter.  A  video  screen  inside  the  aircraft 
displayed  target  objects  and  the  heat  the>  emanated.  The 
imager}'  w'as  recorded  on  high-resolution  videotape 

The  objective  was  to  collect  continuous  S'S-line  imager}' 
of  different  n-pes  of  militar}'  targets.  Four  target  t}'pes  were 
used  —  tank,  armored  personnel  carrier,  truck  and  high 
mobilit}'.  multi-wheeled  vehicle.  .More  than  "0  low-altitude 
runs  w  ere  made  over  two  w  eeks  at  CECO.M  s  C'.entral  Oregon 
Test  and  Evaluation  Facilin. 

Using  the  collected  data,  engineers  will  "teach"  the  auto¬ 
matic  target  recognizer  to  detect  and  classif}  targets  from 

January-f-ebruary  1988 


sensor  output.  As  technolog}  develops,  the  target  recognizer 
will  be  able  to  discriminate  among  friendb  and  hostile  vehi¬ 
cles  and  aircraft,  prioritize  targets  and  direct  fire  toward  the 
highest  threat  target. 

Eventually  the  automatic  target  recognizer  will  be 
mounted  on  remotely  piloted  vehicles.  Viith  the  abilit}  to 
differentiate  between  live  and  spurious  enemy  w  arheads,  the 
automatic  target  recognizer  will  help  driters  of  tanks  and 
other  land  vehicles  navigate  and  lock  in  on  targets. 

The  imager}'  collection  effort  involved  the  use  of  a  unique 
night  vision  system  employing  a  T}  pe  1  utilit}  helicopter  w  iih 
a  target  acquisition  designator  system. 

An  Army  UH-I  helicopter  w  as  fitted  w  ith  a  nose-mounted 
support  for  two  high-resolution  imaging  sensors.  The  tapes 
have  two  audio  tracks,  one  carr}  ing  vertsal  instructions,  the 
other  continuous  range  information  from  the  primar}  target 
to  the  target  areas. 

The  Oregon  National  (iuard  provided  eight  target  vehicles 
and  drivers  for  the  tests.  Tw'o  .\U>0A.^  tanks,  two  .Ml  13 
armored  personnel  carriers,  rw'o  ,M33  2'  j-ton  trucks  and  two 
of  the  Army's  new'  high  mobility,  multi-w  heeled  vehicles  w  ere 
split  between  the  two  target  areas  a  little  over  six  miles  apart. 
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